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A Two-Hundred-Foot Yardstick 
with Graduations Every Microinch 

This new and innovative laser interferometer is ready to measure 
distance with no warmup at all. From its specially designed 
two-frequency laser and heterodyning techniques it derives increased sensitivity 
and resistance to air turbulence. With its internal 
computer it can smooth jittery readings, calculate velocity, and improve resolution. 

By John N. Dukes and Gary B. Gordon 



A laser beam makes an eminently practical working 
standard for measuring length. With its high degree of 
coherence, it is usable over distances of hundreds of feet. 
Its short wavelength permits resolution into the micro- 
inch range. Its wavelength can be determined to a high 
degree of accuracy — parts in I0 ; or better. It is locked 
to an atomic transition in neon and to the velocity of 
light, and does not require periodic rccalibrations. On 
this yardstick, the graduations are laid down by nature 
herself. 

The new HP Model 5525A Interferometer is a port- 
able distance-measuring standard which takes advantage 
of these desirable laser attributes, and incorporates as 
well a number of refinements which give it significantly 
better performance, reliability, and ease of use than other 
interferometers. It measures distances from zero to more 
than 200 feet. It has one microinch resolution (0.4 /.in 
or 10 ' m when measuring in metric units) and is accu- 
rate within five parts in 10 7 . There is no need to wait an 
hour or more after turn-on for it to warm up; it meets its 
accuracy specification immediately and maintains itself 
in tunc automatically. It has electronic averaging to make 
readings rock-steady even in the presence of minute vi- 
brations, and it has unusual immunity to air turbulence, 
the most common cause of poor interferometer perform- 
ance. 

Fits In a Suitcase 

The interferometer has three components (see Fig. 1): 
a laser head that generates a low-power laser beam, a 
reflector that returns the beam to the laser head, and a 
control box that computes and displays the readings. The 
entire system is so compact that it can easily be carried 
from place to place in a suitcase. It weighs only 44 
pounds. 




In practice, either the laser head or the reflector is 
mounted on the device whose movement is to be mea- 
sured, and the other unit is mounted at a fixed point. The 
control box can be placed anywhere allowed by the single 
1 5-foot cable connecting the box to the laser head. 

The reflector is a glass trihedral prism, or 'cube corner! 
similar to the ones recently placed on the moon. Distance 
is measured by electronically counting wavelengths of 
light. Distance change is measured, rather than the abso- 
lute distance between the laser head and the reflector. 
Thus any point may be defined as a zero reference. 

Cover: Model 5525A Laser 
Interferometer has one-mi- 
croinch resolution (0.4 mi- 
croinch when displaying in 
metric units), but what does 
this mean? We decided to 
find out. and this cover is 
the result. That's a four-foot- 
long aluminum beam, and 
the penny deflects the cen- 
ter of it about a microinch. 
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Fig. 1. Model 5525 A Laser In- 
terferometer is a rugged, easy- 
to-use distance-measuring sys- 
tem with a range of 200 teet. 
accuracy better than 5 parts in 
10'. and usable resolution bet- 
ter than one microinch. Its new 
two-lrequency laser warms up 
Instantly, runs cool, and doesn't 
mind air turbulence, the most 
common cause ot poor interfer- 
ometer performance. 




Fig. 2. Model 5525A Interfer- 
ometer has 10 microinch resolu- 
tion in NORMAL and SMOOTH 
modes, one microinch in X 10 
mode. In the SMOOTH mode, 
successive readings are aver- 
aged to eliminate vibration-in- 
duced jitter in the display. The 
system can also display the 
moving reflector's velocity, up 
to 720 in/min. Behind the door 
at right are thumbswitches lor 
setting in velocity-of-light cor- 
rections. 



To convert from wavelengths of light to useful units 
of inches or millimeters the interferometer performs sev- 
eral operations. The wavelength, about 25 microinches, 
is first divided electronically to finer than one microinch. 
The result is then multiplied digitally by the wavelength 
of the laser light in either English or metric units, cor- 
rected for slight variations in the velocity of light due to 
the temperature, pressure, and humidity of air. and finally 
displayed to 9 digits as the distance traversed. 
Two Frequencies Fight Turbulence 

The interferometer derives its immunity to air turbu- 
lence from a new two-frequency system, described in de- 
tail later in this article. Turbulence has always been a 
serious problem for laser interferometers. The same heat 
waves that cause a distant image on the horizon to flutter 
can also affect the laser beam. The effect is equivalent to 
an intensity variation. Similar intensity variations are pro- 
duced by absorption and dispersion from atmospheric 
contaminants such as smoke or oil mist, and by dirt films 
on the optical surfaces. A measure of an interferometer's 
ability to operate under these adverse conditions is the 



maximum loss of returned beam it can tolerate. 

Where most interferometers are comfortable with 50% 
loss of signal, the two-frequency interferometer tolerates 
more than 95%. This additional margin of safety also 
frees the two-frequency interferometer from periodic 
electrical adjustments. There are no adjustments for 
beam intensity or triggering threshold. Furthermore, the 
interferometer tolerates signal variations produced when 
the reflector is rotated, so it can make measurements such 
as dynamic growth of a lathe spindle resulting from bear- 
ing self-heating. 

Special Laser Designed 

The heart of the interferometer is a unique single-mode 
helium-neon gas laser specifically designed for this appli- 
cation. Its output is a continuous red beam at 632. 8nm 
(6328A). Conventional laboratory lasers are stabilized by 
placing them in an oven, but for a portable distance- 
measuring device this presents two drawbacks. First, the 
time required for the oven to stabilize can approach an 
hour, and second, the heat of the oven can cause the ob- 
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ject being measured to expand, thereby invalidating the 
results. In the new laser, the laser cavity is stabilized by 
using an internal zero-coeflicient-of-expansion structure, 
combined with a servo loop for automatic tuning. The 
results are zero warmup time and a cool-running optical 
head. Also, since the tuning system doesn't have to dither 
the laser frequency to find line center, the display is 
steadier than that of other interferometers. This laser is 
the subject of the article beginning on page 14. Other 
design goals contributing to its unusual configuration 
were long lifetime and ruggedness. 

Modes of Operation 

The new interferometer has several modes of opera- 
tion. In the normal mode display is nearly instantaneous, 
to a resolution of 10 millionths of an inch. In this region 
one becomes suddenly aware of how flexible even mas- 
sive structures can be. Granite surface plates and large 
machines may be deformed by mild pressures, and vibra- 
tions produced by nearby motors produce small rapid 
dimensional fluctuations. When present these are seen as 
superimposed digits in the rightmost display tube, since 
the vibrations are faster than the eye can resolve. 

Frequently one would like to sec through such vibra- 
tions to observe other detlections, such as machine de- 
flection under loading by the workpiece. The 'smoothing' 
mode of operation effectively accomplishes this. In this 
mode, a sequence of measured values is low-pass-filtered 
digitally so the display shows the average position rather 
than the instantaneous position. Thus the reading be- 
comes rock-steady. 

The normal and smoothed modes display distance with 
a resolution of 10 millionths of an inch, or about one 
five hundredth the diameter of a human hair. Fine as 
this is. there are applications in metrology, photogram- 
mctry. and integrated-circuit mask-making for which 
more resolution is desirable. In the X 1 0 mode resolu- 
tion is electronically extended by interpolating between 
fringes. Resultant resolution is one microinch in English 
units, or 10 * m in metric units. 10 "m (0.4 microinches) 
is about 25 times the atomic spacing in a crystal lattice. 

An internal time reference is included for digital ve- 
locity or feed rate measurements up to 1 foot/second 
or 720 inches/minute. These are derived by subtracting 
subsequent distance measurements at precisely known 
intervals. 

Velocity of Light Corrections 

Behind a front-panel door (Fig. 2) is a vernier for 
making, in effect, fine and calibrated adjustments in the 



length of the standard. An example of its use is in cali- 
brating a machine at an elevated temperature, say 78°. 
and correcting the results back to 68°. If the machine 
is cast iron and has a coefficient of expansion of 6.5 
ppm/°F, then it will be 65 ppm too large at 78°F Cor- 
rection is effected by subtracting 65.0 from the thumb- 
wheel switch reading. 

Another use for these switches is to make slight cor- 
rections for variations in the velocity of light for very 
precise measurements. A simple table converts readings 
of barometric pressure and air temperature into the 
proper number to enter on the switches. 

Within a few months an accessory will be available 
which will automatically compute the velocity-of-light 
correction. It will have sensors to measure air pressure, 
air temperature, and machine temperature. There are 
good arguments for both approaches: manual entry of 
the correction factor has the advantage of being both 
economical and conducive to good measurement tech- 
nique, while automatic compensation saves a few oper- 
ator steps but requires periodic recertification to main- 
tain accuracy. Other accessories, which are available 
now. are a printer and a 90° beam-bender. 

Human Engineering 

Many man-hours went into the human engineering of 
the interferometer, and the result proves that a basic 
length-measuring instrument need not be complicated to 
be accurate. For example, the operations of starting the 
laser, tuning and locking it. and resetting the display are 
performed automatically when the power switch is turned 
on. Seldom-used controls such as electrical self-checks 
arc placed behind a front panel door. Only low voltages 
are carried on the cable to the interferometer, so no shock 
hazards are present should a chip cut into the cable. 
For easier readability, insignificant leading zeros on the 
display arc automatically blanked. Front-panel range 
changes or units changes (e.g., metric to English) do not 
destroy the distance information, and when the instru- 
ment is switched out of velocity or feed-rate mode, the 
distance reading is still valid. 

The cube-corner reflector was designed for unusual 
versatility in mounting and ease of alignment (Fig. 31. 
Holes allow 90° rotation, and turning a single knurled 
ring clamps all axes. The base may be interchanged with 
standard magnetically clamped bases. The column and 
a rear shoulder on the housing are both % inch in diam- 
eter, for easy retention in collets or chucks. There is also 
a rear thread for mounting the cube-corner perpendicular 
to flat surfaces. 

4 
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How Interferometers Work 

When Apollo 1 1 landed man on the moon for the first 
time, a corner reflector was set up as part of an experi- 
ment to measure the distance to the moon very precisely. 
Laser pulses were bounced off the reflector, and the time 
of travel of the envelope of each pulse was a measure of 
the distance. A radar measures distance in the same way, 
but at a lower carrier frequency. 

Interferometers measure distances in a different way. 
that is, by counting wavelengths of the carrier signal, 
rather than by measuring the travel time of the envelope 




Fig. 3. Reflector, or 'cube corner', is designed tor easy 
mounting in a variety ot ways, and tor easy alignment. 
Turning a single knurled ring clamps all axes. 



of the carrier. All modern interferometers are based on 
techniques pioneered by A. A. Michelson in the 1890's 
(Fig. 4). 

Michelson used a half-silvered mirror to split the beam 
from a light source into two beams, each of which was 
reflected from a mirror and again recombined at the half 
silvered mirror. With the mirrors exactly aligned and 
motionless the observer sees a constant intensity of light. 
But if one of the mirrors is moved very slowly the ob- 
server will see the beam repeatedly increasing and then 
decreasing in intensity as the light from the two paths 
adds and cancels. Each half wavelength of mirror travel 



means a total optical path change of one wavelength and 
one complete cycle of intensity change. If the wavelength 
of the light is known, then the travel of the mirror can 
be accurately determined. It's important to note that the 
distance out to the moving mirror may not be known; 
interferometers measure the changes of position of the 
mirrors with respect to each other. 

To convert Michelson's apparatus into an electronic 
measuring instrument basically requires only a photocell 
to convert beam intensity into a varying electrical signal, 
and an electronic counter to tally the cycles of beam in- 
tensity. To make such a device practical, however, sev- 
eral other improvements are necessary. 

First, because mirror alignment is extremely critical, 
modern interferometers use cube corners instead of mir- 
rors. Cube corners reflect light parallel to its angle of 
incidence regardless of how accurately they are aligned 
with respect to the beam. Second, modern interferometers 
use lasers as light sources, for two reasons: if the inter- 
ferometer is to be used over any significant distance the 
light must be pure, i.e., single wavelength; if the interfer- 
ometer is to be accurate, the wavelength must be exactly 
known. The laser satisfies these criteria beautifully. 

A third improvement is direction-sensing electronics. 
A single photocell isn't sufficient to sense which way the 
reflector is being moved. The method used by most inter- 
ferometers to sense direction is to split one of the opti- 
cal beams into two portions, delay one portion in phase 
by 90°. and then, after recombination, detect each por- 
tion of the beam using a separate photocell. This tech- 
nique gives two signals which vary sinusoidally in inten- 
sity as the reflector is moved, and they differ in phase 
of brightness by 90°. These two signals, after dc ampli- 
fication, can be used to drive a reversible counter, and 
the phase separation is sufficient to inform the counter 
of the direction sense of the motion. 

Although all commercial interferometers to date have 
been built this way. there is a fundamental problem with 
this conventional system. Fig. 5(a) illustrates the output 
of one of the photocells as one of the reflectors is mov- 
ing. Notice that the intensity variations are centered 
around the triggering levels of the counter. But if the 
intensity of either light beam or the intensity of the source 
should change, the variations in intensity may not cross 
the triggering levels. Fig. 5(b) illustrates this condition. 
Thus a change in intensity can stop operation until the 
trigger levels are readjusted. Such a change in intensity 
conventionally occurs as the laser ages; it always occurs 
when turbulence either deflects the beam slightly or warps 
the wavefront. and. while trigger levels can be adjusted 
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Fig. 4. Laser interferometers are based on the Michelson 
interferometer ol the 1890's. It one ot the two mirrors 
moves, the observer sees the light repeatedly increasing 
and decreasing in intensity as light from the two paths 
alternately adds and cancels. Each cycle of Intensity 
corresponds to a hall-wavelength ol mirror travel. It the 
wavelength ot the light is known, intensity cycles can 
be counted and converted to distance traveled. 

for long-term changes, no automatic trigger-level adjust- 
ments can follow the fast changes in intensity one usually 
finds in a shop atmosphere where the interferometer is 
often used. 

Two Frequencies Are Better Than One 

The new HP interferometer operates on a heterodyne 
principle and completely avoids this problem. While con- 
ventional interferometers mix two light beams of the same 
frequency, the HP interferometer uses a two-frequency 
laser and mixes light beams of two different frequencies. 
Fig. 6 is a diagram of the system. 

The virtue of the two-frequency system is that the 
distance information is carried on ac waveforms, or car- 
riers, rather than in dc form. Unlike dc amplifiers, ac 
amplifiers are not sensitive to changes in the dc levels of 
their inputs. 

The ac signals representing distance change are gen- 
erated in a manner exactly analogous to the intermediate 
frequency carriers in the everyday FM heterodyne radio 
receiver. The ac signal or 'intermediate frequency' is pro- 
duced by mixing two slightly different optical frequencies, 
near 5 x 10" Hz. differing by only parts in 10'. If these 
had to be generated by different sources, the stability re- 
quirements would be almost prohibitive. But by a for- 
tunate circumstance, a laser can be forced to oscillate on 
two frequencies simultaneously, simply by applying an 
axial magnetic field. The two frequencies that result are 
very close together, but the corresponding components of 
the laser beam have opposite circular polarizations and 
can therefore be separated by polarized filtering. 
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Fig. S. Most laser interferometers use dc systems in 
which intensity changes due to aging or air turbulence 
can interfere with triggering and cause improper count- 
ing. The new HP interferometer uses an ac system which 
doesn't have this problem. 

One of the two frequency components is used as the 
measuring beam and reflected from the cube corner. On 
return it is mixed with the second frequency, or 'local 
oscillator' in receiver language. The mixing produces the 
well-known fringe patterns of alternate light and dark 
bands caused by alternate constructive and destructive 
interference. The eye can't resolve these bands, however, 
since they flicker at a rate of several million per second. 
If the movable cube-corner reflector happens to be sta- 
tionary, the rate will be exactly the difference between 
the laser's two frequencies, about 2.0 million fringes/ 
second. Now if the reflector is moved, the returning beam's 
frequency will be Doppler-shiftcd up or down slightly, 
as with a passing train's whistle. A reflector velocity of 
one foot per second causes a Doppler shift of approxi- 
mately 1 MHz. This fringe frequency change is monitored 
by a photodetector and converted to an electrical signal. 
A second photodetector monitors fringe frequency before 
the paths are separated, as a reference for the fringe rate 
corresponding to zero motion. 

These two frequencies from the photodetectors are 
next counted in a form of reversible counter. One fre- 
quency produces up-counts, the other down. If there is 
no motion, the frequencies are equal, and no net count is 
accumulated. Motion, on the other hand, raises or lowers 
the Doppler frequency, producing net positive or negative 
cumulative counts corresponding to the distance traversed 
in wavelengths of light. 
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Fig. 6. In the HP interferometer, two frequencies are generated by the laser and sep- 
arated by optical filters of opposite circular polarizations. The beam ot frequency f, 
is Doppler-shifted as it bounces off the moving reflector. The returned beam is opti- 
cally mixed with the beam of frequency I-. and the difference frequency is detected, 
amplified, counted, and converted to distance traveled. 



IC Calculator 

A small inlcgratcd-circuit calculator converts these 
wavelengths to English or metric units of length. The low 
cost, small size, and high reliability of IC's make such a 
calculator feasible for this application. And as a bonus, 
having the flexible calculator present makes it economical 
to include other functions, such as smoothing, resolution 
extension, and velocity computation. 

Smoothing is done by first storing the previous dis- 
tance reading. Then when a new distance is computed, 
it is not displayed. Rather, the previous distance reading 
is changed slightly (0. 1 % ) toward the new distance, and 
this result is displayed. Consequently the display is slug- 
gish to rapid changes. This digital low-pass filtering is the 
logic designers counterpart of the mechanical engineer's 
dashpots and the analog designer's RC filters. Resolution 
extension is achieved in much the same way. by random 
sampling and averaging. Velocity is computed by sub- 
tracting subsequent readings at tenth-second or thou- 
sandth-minute intervals. S 
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SPECIFICATIONS 

HP Model 552SA 
Laser Interferometer 



ACCURACY (exclusive ol velocity ot light, alignment and wofk piece temperature) 

5 parts in 10-' -1 count in least significant digit 1*2 counts in metric units) 
RESOLUTION (lent count) 
NORMAL MODE 0 00001 in or 0 000? mm 
x 10 MODE 0 000001 in or 0 00002 mm 
OPERATING RANGE: 200 ft 60 meters in typical machine shoti environments 
MAXIMUM MEASURING VELOCITY: 720 in/min II (t/s). 03 m/s. 
VELOCITY MEASUREMENT: 
RANGE- 
ENGLISH' 0 10 t2 in/s 0 to 720 In/mm 
METRIC- 0 to 300 mm/a, 0 to 18.300 mm/mln 
ACCURACY AND RESOLUTION 

ENGLISH: -0 0001 m/s. "0 01 in/mm 
METRIC -:0 002 mm/i -0.2 mm/mm 
WARMUP TIME: None 

LASER TUNING: Laser tuning is automatic. 

DISPLAY: 9 digits with appropriate decimal point and comma, and + or - sign 
UNITS 

NORMAL SMOOTH and • 10 MODES, in. mm. I* 
VELOCITY MODE in/s in/mln. mm/* or mm/min 
Display in all modes INormal. Smooth, ■ 10. and Velocity) and all units available 

at any lime during or alter a measurement without loss of any Information 
Nonsignlticant leading zeros are blanked tor readability 
RESET: Pushbutton reset to zero. 
ERROR INDICATORS: Seam interrupt, overspeed 
TEST CIRCUITS: 

front-panel pushbutton-operated lest circuits verily that all computing circuits are 



operating properly 

ALIGNMENT TO MEASURING AXIS: 

Built-in three-point kinematic suspension and precision adjustment permits accurate 
alignment to measuring a«is Signal strength meter on front panel makes possible 
easy positioning ol relroreflector fot moximurn optical signal 

INTERCHANGEABILITY: 

Any HP inteiferometor head wilt operate with any HP display unit. 

VELOCITY OF LIGHT COMPENSATION: 

A combined factor for barometric pleasure, temperature and humidity is derived 
Itom a supplied table The factor, directly in parts per million with 0 1 ppm resolu- 
tion is manually entered via thumbwheel switches The range ' this 'actor is large 
onoug" to cover any possible set ol environmental conditions 

MATERIAL THERMAL EXPANSION COMPENSATION: 

Thermal expansion compensation in pans per million is manually entered via thumb- 
wheel switches 

INPUTS: 

Automatic velocity ol light compensation oi remote manual VOL compensation 
Auxiliary Remote wonl panel contiols. i e . Reset. Manual Print. Normal. Smooth, 
< 10 Velocity Tuning Error. Beam Interrupt Error 

OUTPUTS: 

BCD output lor printer, computer. Fourier analyser, etc Timed contact closure 'or 
automatic NC test advance, or periodic data recording aoplicaltons. 
PRICE: Model 5525A (Includes Model 5500A Interferometer Head. Model S505A Dis- 
play, and Model I0550A Reflector! tll.SOO.OO. 

MANUFACTURING DIVISION: SANTA CLARA DIVISION 

S30I Stevens Creek Boulevard 
Santa Clara. California 9SOS0 
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A New Tool for Old Measurements - and 
New Ones Too 

By Andre F. Rude and Kenneth J. Wayne 



Although Model 5525A Laser Interferometer measures dis- 
tance and velocity with great range and accuracy, it is 
nevertheless practical and economically justifiable to use 
it for making gross low-accuracy measurements, since it is 
fast and easy to use. The diagram illustrates the spectrum 
of its applications. 

The primary application is in calibration of numerically 
controlled machine tools and coordinate measuring ma- 
chines in the machine shop and metrology lab. The laser 
beam can be aligned parallel to the axis of a machine tool 
or measuring machine in a few minutes. Because the system 
requires no warmup, calibration may begin immediately. 
Complete calibration of a three-axis machine tool with a 
printed record and/or a graph of errors versus command 
position can be accomplished in a few hours, compared 
with days by conventional methods. What's more, conven- 
tional methods do not automatically generate a graph. No 
specially trained personnel are needed, since the new inter- 
ferometer is very simple to operate. 

New for a laser interferometer is the ability to measure 
the axial growth of a rotating spindle due to frictional heat 
in its bearings. The cube-corner reflector is chucked and 
spun in the spindle and the beam is aligned parallel to the 
axis. This cannot be done with a conventional interferometer 
because, when the nonreflecting edges of the cube corner 
pass through the beam, the optical signal drops below the 
level at which the counter can safely trigger. The new 
interferometer, however, can tolerate a 95% loss of optical 
signal without error, so the small amount of light lost as the 
cube-corner edges go through the beam is hardly even 
noticed. 

Since this laser interferometer also measures velocity, it 
is possible lo calibrate machine tool feed rate at the same 
time positioning accuracy is measured. 

In the metrology laboratory the new interferometer is use- 
ful for calibration of other length standards such as mi- 
crometer heads, tool-makers' microscopes, glass and metal 
scales, and even low-accuracy steel tapes over 200 feet 
long. With suitable fixturing it can be used for parts inspec- 
tion. 

It is particularly noteworthy that metrological calibrations 
may be performed continuously rather than in discrete steps 
as required with gage blocks The HP error plotting option 
generates a continuous plot of leadscrew error versus 
position that allows the metrologist to see short-term varia- 
tions in lead (leadscrew drunkenness) which otherwise 
might be obscured by the 'synchronous sampling' of gage 
blocks Also the error incurred by transferring a measure- 
ment from a part to a stack of gage blocks can be avoided. 

In keeping with the present trend toward on-the-machine 
inspection, the new interferometer is a natural for use as a 
length standard. The machine tool is converted to an N/C 
measuring machine by replacing the cutting tool with a 



contact probe and using the laser interferometer as the 
position transducer. The same tape used to machine the part 
is used to control the inspection process. A part may be in- 
spected in its fixture immediately after machining. 

Model 5525A Interferometer is already used as a preci- 
sion option on conventional N/C machine tools that have 
their own built-in position transducers. With this arrangement 
it is possible to machine to normal tolerances with N/C. 
Then, for precision machining, the controller turns the ma- 
chine over to the operator who manually positions one axis 
at a time using the laser interferometer. An example of this 
use might be precise locating of dowel holes in a large part. 
With the aid of beam benders, a single HP interferometer in 
a fixed mounting location can be used to position all axes 
of a machine. 

From here it is only a short step to complete closed-loop 
N/C or computer control of the machine tool. 

Other applications for the new interferometer are in con- 
trol of step-and-repeat cameras for integrated-circuit pro- 
duction, in control of artwork generators, in mapmaking, 
and in photogrammetry. Stress-analysis and thermal-expan- 
sion-coefficient measurements of interest to the mechanical 
engineer and metallurgist are easily made, and physicists 
can make index of refraction measurements. A new and still 
experimental application is predicting earthquakes by accu- 
rate long-term measurements of earth movement in fault 
locations. 

As for the future, who knows what is possible when you 
can measure a microinch? 
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Automatic Error Plotting— a Report Card 
for Nonlinear Behavior 

By Jonathan D. Garman 



In almost every calibration of a linear system, the 
desired result is a plot of system error as a function of 
some calibration parameter. In the case of machine tool 
calibration, the calibration parameter is the nominal or 
command position of the machine tool along one of its 
axes, and the error is the difference between the actual 
position and the command position. 

Although laser interferometers have greatly increased 
the accuracy and speed of machine-tool calibrations, 
methods of deriving errors and presenting them graphi- 
cally have been largely unsatisfactory, ranging from tedi- 
ous manual methods to complex, expensive automatic 
systems. 

The main stumbling block in the automatic approach 
is that the command position of the machine tool is awk- 
ward to obtain in electrical form. In manual machines, 
of course, the command position is simply not available. 
In some automatic machines it is available, but codes are 
not standardized and vary from machine to machine. 
Even when the command position is available in elec- 
trical form, dozens of interconnections are required to 
make use of it. 

New Error Plotting System 

The HP approach doesn't solve these problems, it side- 
steps them by making a few nonrestrictive assumptions 
about machine errors. As a result, automatic error plot- 
ting becomes a simple task, requiring only an inexpensive 
plug-in option for the interferometer, a single two-wire 
cable to the machine tool, and an X-Y recorder. The 
only signal required from the machine is a simple syn- 
chronization pulse to signify that the machine is in nomi- 
nal position on a calibration point. 

The principal assumption made in implementing the 
error plotting system is that the largest error to be en- 
countered will be less than half the interval between cali- 
bration points. If the errors prove to be larger than this, 
the interval can be widened appropriately. The interval 
between calibration points can be any integral multiple 
of 0.010 inch and the range is 100 inches. Longer scales 
can be calibrated in 100-inch segments. If the interfer- 



ometer is operating in the extended-resolution mode all 
these numbers are divided by 10. The full-scale position 
is selectable, and accuracy is constant (approximately 
0.5% of reading) whether full scale is one inch or 100 
inches. 

How the system works is best explained by an example. 
Suppose that a positive error exists at three calibration 
points and the interferometer readings are 4.00012 
inches. 4.10017 inches, and 4.20023 inches. The error 
plotting system breaks each reading into two parts and 
assumes the right-hand part is the error and the left-hand 
part is the command position. It then plots each right- 
hand part as a function of each left-hand part. Thus 
12. 17, and 23 are assumed to be the errors in tens of 
microinches at the calibration points 4.00000 inches. 
4.10000 inches, and 4.20000 inches, respectively. In 
other words, the system derives both command position 
and error just by inspecting the interferometer display. 
There is no need for complicated computations and mas- 
sive interfaces. 

When negative errors are encountered, the right-hand 
digits are complemented to obtain the correct absolute 
value of the error. The left-hand digits are incremented 
by one unit so the error will not be plotted one step too 
low. 

Modes of Operation 

The error plotting option operates in one of several 
modes, depending upon the type of machine being cali- 
brated. For a full N C machine tool, a command tape 
is prepared to position the machine sequentially to the 
desired calibration points.* The interferometer contacts 
are clipped in parallel with the manual-step button. The 
contacts step the machine through the control tape point- 
by-point, plotting the position and error at each calibra- 
tion point. The stepping rate is front-panel selectable. 

When calibrating a manually controlled machine such 
as a manual milling machine, the machine is placed in 
control of timing. A pulse must be generated each time 
the machine moves one calibration interval. This can be 
(and has been) done either by having a microswitch drop 

• Some newer N/C controllers don't require the command tape. 
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Graphic displays, like these 
generated by the error plotting 
option lor Model 55254 Laser 
Interlerometer. show machine 
errors in perspective. Both plots 
were made during a calibration 
ol one axis ol a numerically 
controlled milling machine that 
was suspected ot being out ol 
specilication over large dis- 
tances. The top plot shows the 
error at 0.1 inch intervals over 
the entire 24-inch axis. The up- 
ward slopes reveal that the ma- 
chine's three 10-lnch internal 
scales are all long by 50 parts 
per million. The rightmost scale 
is also 0.0005 inch out ot posi- 
tion, as shown by the downward 
step, which is broadened by the 
etlect ol the machine's three- 
inch -wide read head. Plotting 
time was four minutes. The bot- 
tom plot magnifies a 0.2 inch 
section ot the same scale, 
showing the error at 0.001 inch 
intervals. There is a cyclic error 
with a peak value ol 0.0005 
inch, indicating misadjustment 
of the electronic circuits which 
interpolate between the 0.1 inch 
marks ol the machine's induc- 
tive scales. Similar cyclic errors 
are often seen on leadscrew 
machines and micrometers. 



into teeth on a gear on the drive leadscrew. or by a lamp- 
photocell combination looking through a slotted disc 
driven by the leadscrew. The pulse commands the inter- 
ferometer to make a measurement and plot the error. 
Measurements are taken on the fly. that is. without stop- 
ping the machine at each calibration point. 

When it is impractical to generate an automatic syn- 
chronization signal, the synchronization can be done 
manually. This might be necessary, for example, in cali- 
brating a precision microscope stage or a micrometer. 
The operator would position the instrument manually, 
and when ready he would press the MANUAL PLOT 
switch to plot the error. S 
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An Instant-On Laser 
for Length Measurement 

This specially developed two-frequency laser is 
rugged, tunes itself instantly, and runs cool. 

By Glenn M. Burgwald and William P. Kruger 



Soon after its invention ten years ago, some clever 
fellow characterized the laser as 'a solution looking for a 
problem^ That solution has now found problems aplenty, 
ranging from eye surgery through metal cutting to high- 
density data storage and retrieval, to name but a few. 
Another such problem is the precise measurement of dis- 
tance, made feasible by the coherence and accurately 
known wavelength of laser light. When a laser is used 
as the light source in an interferometer, distance measure- 
ment is a simple matter of counting interference fringes, 
each count signifying another few millionths of an inch 
of distance. 

For the new HP Laser Interferometer described in the 
article on page 2. an entirely new laser was developed. 
Designed specifically for interferometry, it is a single- 
mode helium-neon laser in which Zecman splitting is 
used to divide the main spectral line into two lines sep- 
arated in frequency by about 2.0 MHz. The laser is ex- 
tremely rugged, can be locked on frequency without 
warmup. and is designed to operate reliably in industrial 
use for 10.000 hours or more. 

Single-Mode Operation 

To avoid ambiguity in translating light wavelengths 
into distance, the laser operates in a single transverse 
mode and a single longitudinal mode. It has a 'hemi- 
spheric' mirror system in which a flat and a spherical 
mirror face each other at opposite ends of a gas-discharge 
bore of predetermined length and diameter. By adjusting 
mirror spacing, diffraction losses are set so that only the 
lowest-order transverse mode. TEM„„. can oscillate. Fig. 
1 illustrates power output versus mirror spacing for a 
given bore diameter, and shows typical mode bounds. 
The laser operates as high on the power curve as possible 



without danger of developing spurious transverse modes. 

Single-longitudinal-mode operation is achieved by 
using a mirror spacing of approximately 13 cm, a value 
sufficiently small to keep adjacent modes in regions of 
low gain and thus prevent their simultaneous oscillation. 
Fig. 2 shows how laser gain varies with frequency for 
the Doppler-broadcned 6328A (632.8 nm) line of he- 
lium-neon. Mode spacing is c/2/. where c is the velocity 
of light and / is the mirror spacing. A proper choice of / 
is one which safely suppresses adjacent modes when some 
one mode is at maximum gain. But with l/R constant (R 
is mirror radius of curvature) smaller / means smaller 
output power. Optimum spacing is 13-15 cm. 

Zeeman Splitting 

Although single-mode operation is necessary to avoid 
ambiguities, a better interferometer can be built if two 
adjacent frequencies are available rather than a single 
one (sec article, page 2). In the new HP laser, two fre- 
quencies are obtained by Zeeman splitting of the main 
spectral line. Here's what this means. 

If an axial magnetic field is applied to a laser which 
is free from polarization anisotropy in either the mirrors 
or the plasma tube, the output splits into two frequencies 
of left and right circular polarization as shown in Fig. 3. 
First-order theory predicts that the frequency splitting is 
proportional to magnetic field strength and to the ratio 
of line Q to cavity Q. In the new laser, magnetic field 
strength is adjusted for a difference frequency of about 
2.0 MHz. Line center is virtually midway between the 
displaced lines, so proper cavity tuning can be assured 
by adjusting for equal intensities of the lines. 

Fig. 4 is a photograph of the interior of the laser head, 
showing the axial magnet. 
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Fig. 1. Laser power output versus mirror spacing tor a 
given diffraction aperture (bore diameter), showing typi- 
cal transverse-mode bounds. New HP laser operates in 
TEMk mode only, but as close to TEM„ region as pos- 
sible, so as to maximize power output. 

Cavity Design and Tuning 

The requirement of no polarization anisotropy. which 
must be satisfied for Zccman splitting, precludes use of 
a plasma tube with Brcwster-angle windows, since such 
windows have low reflection loss for only one kind of 
polarization. This in turn means that internal mirrors 
are obligatory. Also, it was a design objective that the 
laser be tuned to line center as soon as it is turned on. 
and this means that the plasma tube, or cavity, must in- 
clude a tuning element to compensate for small changes 
in length. 

The cavity design satisfies both these requirements. A 
sturdy rod. about an inch in diameter, of one of the new 
inorganic materials having virtually a zero coefficient of 
thermal expansion, is used as a combined plasma tube 
and mirror spacer. It has an axial hole of the proper size 
to control transverse-mode excitation, and the ends are 
precision-ground to provide proper mirror alignment. 

Cavity length changes during and after warmup are 
small enough to be compensated by a piezoelectric wafer 
which forms part of an electronic servo loop. The loop 
monitors the intensities of the Zeeman-split lines and 
keeps them equal by varying the voltage on the piezoelec- 
tric element. The tuning range is adequate to compensate 
for all expected thermal length changes without the need 
for an oven. 

This very stiff and stable resonator is encased in an 
all-glass envelope through which are brought appropriate 
electrical leads to generate a gas discharge and to apply 
voltage to the piezoelectric tuning element. Since no 
organic cements are used, the laser can be given high- 
temperature vacuum bakeout before final filling. This 
removes gas contamination as a factor tending to reduce 
the life of the laser. 



Pig, 2. This is the Doppler-broadened gain curve for the 
6328A (632.8 nm) line ol helium-neon. In the new HP 
laser, cavity length (I) is about 13 cm, so only a single 
longitudinal mode can oscillate. 

Long-Life Mirrors 

Because of the modest gain-pcr-pass in this type of 
laser, photons must be reflected back and forth many 
times through the cavity to achieve oscillation, and hence 
the mirrors must have extremely good reflectivity. Only 
tuned multilayer dielectric surfaces have the needed re- 
flectivity at optical wavelengths. These coatings must be 
able to withstand evacuation, high-temperature bakeout. 
and exposure to all radiation from the discharge includ- 
ing ultraviolet. Unfortunately, the 'soft-coated' mirrors 
typically used externally, although excellent reflectors, 
deteriorate upon exposure to ultraviolet light in at most 
a few hundred hours. 

Coating manufacturers have exerted a great deal of 
effort to achieve 'hard' coatings unaffected by ultraviolet 
light, and have found that alternate layers of silicon di- 
oxide and titanium dioxide, for example, can provide 
adequate reflectivity and yet not deteriorate from ultra- 
violet exposure. They also withstand the thermal cycling 
of good vacuum practice. The new laser has mirrors of 
this type. Long-term life tests are under way, and some 
arc now approaching 20.000 hours. Therefore, it seems 
possible to conclude that hard-coated mirrors properly 
made and used do not limit laser life. 

Long-Life Discharge 

Eliminating the most common cause of laser failure — 
contamination of the fill gases — docs not in itself assure 
infinite laser life. Mechanisms exist by which the noble 
gases helium and neon can be lost to the discharge. For 
instance, helium diffuses rapidly through certain glasses. 
To minimize this, the new laser's envelope is made of a 
material which is very low in helium diffusion. 

A different kind of loss involves 'capture' of noble 
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Fig. 3. Two frequencies are derived Irom the single-mode 
laser by Zeeman splitting. An axial magnetic field causes 
the single line to split into two lines. The two frequencies 
have opposite circular polarizations. 




Fig. 4. Interior ot laser head, showing laser with axial 
magnet, telescope, and interferometer components. Pen- 
cil points to magnet. 

gases either within the metallic lattice of the cathode by 
ion penetration, or through a complex sputtering process 
which seems to plate out gas atoms when cathode mate- 
rial migrates to a new surface. In the new laser 'capture' 
factors are minimized by proper cathode design and fill 
pressures. The laser uses a cold cathode of rugged design 
whose long life has been demonstrated. S 
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